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CLAIMS: 

Having thus described our invention, what we claim as new, and desire to secure by Letters 
Patent is: 

1 1\A sampling-based system for ad^tivelyogrimzmg a computer program executing in an 

2 execution environment, said execution environment including one or more compiler devices for 

3 providin^yarious levels of program optimization, said system comprising: 

4 \ a runtime measurements sub-system for monitoring execution of said computer 
r-5] program to be optimized, said monitoring including obtaining raw profile data samples and 

M characterizing said raw profile data; 

^$ a controller device for receiving said characterized raw profile data from said 

\M runtime measurements sub-system and analyzing said data for determining whether a level of 

5 program optimization for said executing program is to be performed by a compiler device, said 
fO controller generating a compilatiorrftlan in accordance with a determined level of optimization; 
i=p= and, 

{V. a recom pilation sub-system^for receiving a compilation plan from said controller 

I3j and invoking a compiler device for performing^said level of program optimization of said 
14 executing program in accordance with said comprktion plan. 

1 2. The system as claimed in Claim 1 , wherein said runtime measurements sub-system comprises 

2 one or more organizer devices for processing said raw profile data and characterizing said data as 

3 meeting a hotness threshold of activity. 

1 3. The system as claimed in Claim 2, wherein said runtime measurements sub-system 

2 comprises: 

3 a mechanism for counting a number of samples that are take^from the executing 
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4 program; and, 

5 v a mechanism for comparing the number of samples to a predetermined sampling 

6 sizethreshold, and in response to the number of samples exceeding said sampling threshold, 

7 invoking said organizer device to process said raw profile data. 

1 4. The systerh as claimed in Claim 3, wherein said raw profile data samples relate to one or more 

2 method activations in said executing program. 

1 5. The system as clartned in Claim 4, wherein said organizer device comprises a mechanism for 

2 comparing said raw pro^le data of method activations against a corresponding activity hotness 
X threshold for one or more methods, and identifying one or more methods as meeting said activity 

<P hotness threshold for input to^said controller device. 

'"'"4 \ 

6. The system as claimed in ClainrS, wherein said controller device adaptively adjusts said 

; j sampling size threshold. \ 

M 7. The system as claimed in Claim 4, wherW a level of program optimization includes 

2: recompiling an executing method, said controller device further comprising mechanism for 

P adapting said sampling size threshold in accordance with an amount of recompilation that occurs. 

1 8. The system as claimed in Claim 2, wherein said controller device dynamically adjusts said 

2 activity hotness threshold to adapt to a current behavior of the executing computer program. 

1 9. The system as claimed in Claim 4, wherein said controller instructs the recompilation 

2 subsystem to insert intrusive profiling for one or more identified methods. 
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1 10. The system as claimed in Claim 4, wherein a compilation plan generated by said controller 

2 device comprises an identifier of a method to be optimized; and, an optimization level indicating 

3 a de^se of optimization to be applied for said identified method. 

1 11. The system as claimed in Claim 4, wherein a level of program optimization includes 

2 recompiling anWecuting method, said controller device including a mechanism for identifying a 

3 recompilation leveL that minimizes expected future running time of a recompiled program. 

1 12. The system as claimed in Claim 1 1, wherein said mechanism for identifying a recompilation 

2 level includes: \ 

3^ mechanism fordetermining an expected time Tj the program will spend executing 

a method "m" if said method is ntat recompiled; 
P mechanism for determining a cost Cj of recompiling said method at an 

6j optimization level "j", for i < j < N; and, 

£j mechanism for determining an expected time Tj the program will spend executing 

8 said method in the future, if said method is recompiled at level "j"; and, 
9^ comparison mechanism for evaluating the expression Cj + Tj < T h whereby said 

lgl controller device decides to one ofi generate compilation plan for directing 

li~ recompilation of "m" at level "j" if said expression is true, and, not recompile if 

12 said expression is false. \ 

1 13. The system as claimed in Claim 1, wherein said raw profile data samples are taken at method 

2 prologue and back edge yield points. \ 

1 14. The system as claimed in Claim 1 , wherein said controller instants the recompilation 

2 subsystem to perform online feedback-directed optimizations based o\feedback from the current 

3 executing program. 
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\15. The system as claimed in Claim 14, wherein said raw profile data samples relate to call 

2 context information associated with methods called by said program, said feedback comprising 

3 saicKcall context information. 

1 16. The system as claimed in Claim 14, wherein said raw profile data samples relate to current 

2 program variable values, said feedback comprising a subset of values assigned to said variables 

3 during program execution. 

1 17. The system as claimed in Claim 1 4, wherein said raw profile data samples relate to control 

2 flow execution within a method, said feedback comprising execution frequency of control flow 
;3i paths within said executing method. 

;£j 18. The system as claimed in Clainr^, wherein said execution environment includes an 

!2J interpreter device. 



19. A method for adaptively optimizing a computer program executing in an execution 

!^ environment, said execution environment comprising one or more compiler devices for providing 

jk various levels of program optimization, said methoavcomprising: 

K a) sampling said executing computer program to obtain raw profile data samples; 

5 b) characterizing said raw profile data as meeting a threshold criteria; 

6 c) analyzing said characterized raw profile dark for determining whether a level of 

7 program optimization for said executing program is to be perforated by a compiler device, and 

8 generating a compilation plan in accordance with a determined leveKpf optimization; and, 

9 d) when optimization is to be performed, invoking a compiler device for 
10 optimizing said executing program in accordance with said compilation pi 

1 20. The method as claimed in Claim 19, wherein said characterizing step b) comprises: 

2 processing said raw profile data to determine whether said data meets an activity hor^ess 
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3~ — Ateshold^ 

1 24 . The method as claimed in Claim 20, wherein said sampling includes the steps of: 

2 \ counting said samples that are taken from the executing program; and, 

3 \ comparing the amount of samples taken to a predetermined sampling size 

4 threshold, \vhereby in response to an amount of samples exceeding said sampling threshold, 

5 performing sa^d characterizing step. 

1 22. The method as clamed in Claim 21, wherein said raw profile data sampled relates to one or 

2 more method activations m said executing program. 

y 23. The method as claimed in Claim 22, wherein said step of processing said raw profile data 

^ comprises the steps of: \ 

'3f comparing said raw profile data of method activations against said corresponding 

; ip activity hotness threshold for one or more niethods; and 

I& identifying one or more methods as meeting said activity hotness threshold. 

If 24. The method as claimed in Claim 2 1 , further including the step of adaptively adjusting said 

5g sampling size threshold. \ 

1 25. The method as claimed in Claim 22, wherein said step of okimizing includes recompiling an 

2 executing method meeting an activity hotness threshold, said method further including the step 

3 of adapting said sampling size threshold in accordance with an amount of recompilation that 

4 occurs. \ 

1 26. The method as claimed in Claim 22, further including the step of dynamicaHv adjusting said 

2 activity hotness threshold for adapting to a current behavior of the executing compter program. 
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1 ^27. The method as claimed in Claim 26, wherein said step of dynamically adjusting said activity 

2 hotoess threshold further includes the steps of: 

3 \ determining an amount of methods characterized as meeting said threshold criteria 

4 after one or more sampling periods; 

5 \comparing said amount to a limit; and, 

6 in response to said comparing, one of: decreasing said activity hotness threshold if 

7 said limit is not met, and increasing the threshold if said limit is met or exceeded in said one or 

8 more sampling periods. 

1 28. The method as claimed in Glaim 22, further including the step of inserting intrusive profiling 

2, for one or more identified methoc 

iJB 29. The method as claimed in Claim 24Wherein said step of generating a compilation plan 

;2j includes: providing an identifier of said method to be optimized; and, an optimization level 
indicating a degree of optimization to be applied for said identified method. 

U 30. The method as claimed in Claim 22, wherein saicUnalyzing step c) further includes 

2T identifying a recompilation level that minimizes expects^ future running time of a recompiled 

IM version. 

1 31. The method as claimed in Claim 30, wherein said step of identifying a recompilation level 

2 includes the steps of: 

3 determining an expected time T s the program will spe^d executing a method w m" 

4 if said method is not recompiled; 4 

5 determining a cost Cj of recompiling said method at an optimization level "j", for 

6 i<j<N;and, 

7 determining an expected time T } the program will spend executing said method in 

8 the future, if said method is recompiled at level "j"; and, 
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9 evaluating the expression Cj + T } < T s , and, one of: recompiling "m" at level "j" if 

10 said expression is true, and, not recompiling if said expression is false. 

1 32. The metlrod as claimed in Claim 19, wherein said optimizing step further comprises the step 

2 of performing ohline feedback-directed optimizations based on feedback from the current 

3 executing programs 

1 33. The method as clainted in Claim 32, wherein said raw profile data samples relate to call 

2 context information associated with methods called by said program, said feedback comprising 

3 said call context information. 

; fl 34. The method as claimed in Claim\32, wherein said raw profile data samples relate to current 

i2 program variable values, said feedback comprising a subset of values assigned to said variables 

i3] during program execution. 

H 35. The method as claimed in Claim 32, wherein\aid raw profile data samples relate to control 

\2& flow execution within a method, said feedback comprising execution frequency of control flow 
paths within said executing method. 

1 36. The method as claimed in Claim 19, wherein said executio^environment includes an 

2 interpreter device. 

1 37. A computer program product comprising a computer readable mediuni having recorded 

2 thereon a computer program which, when loaded in a computer, configures \ computer for 

3 adaptively optimizing a computer program executing in an execution environment, said 

4 execution environment comprising one or more compiler devices for providing various levels of 

5 program optimization, said computer program executing method steps comprising: 

6 a) sampling said executing computer program to obtain raw profile data N samples; 
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7 V b) characterizing said raw profile data as meeting a threshold criteria; 

8 \ c) analyzing said characterized raw profile data for determining whether a level of 

9 programyOptimization for said executing program is to be performed by a compiler device, and 

10 generating^ compilation plan in accordance with a determined level of optimization; and, 

1 1 \l) when optimization is to be performed, invoking a compiler device for 

12 optimizing said executing program in accordance with said compilation plan. 

1 38. The computer prograta product as claimed in Claim 37, wherein said characterizing step b) 

2 comprises: processing said raw profile data to determine whether said data meets an activity 

3 hotness threshold. \ 

l4 39. The computer program product a^l^imed in Claim 37, wherein said sampling step includes 

IP the steps of: \ 

3J counting said samples that are taken from the executing program; and, 

$a comparing the amount of samples taken to a predetermined sampling size 

5 threshold, whereby in response to an amount of sampjes exceeding said sampling threshold, 

^ performing said characterizing step. \ 

jjrf 40. The computer program product as claimed in Claim 39, wherein said raw profile data 

2 sampled relates to one or more method activations in said executfng program. 

1 41 . The computer program product as claimed in Claim 40, wherein said step of processing said 

2 raw profile data comprises the steps of: \ 

3 comparing said raw profile data of method activations against\aid corresponding 

4 activity hotness threshold for one or more methods; and \ 

5 identifying one or more methods as meeting said activity hotness threshold. 
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1 f\42. The computer program product as claimed in Claim 39, further including the step of 

2 aoaptively adjusting said sampling size threshold. 

1 43. Th^scomputer program product as claimed in Claim 40, wherein said step of optimizing 

2 includes recompiling an executing method meeting an activity hotness threshold, said method 

3 further including the step of adapting said sampling size threshold in accordance with an amount 

4 of recompilation mat occurs. 

1 44. The computer program product as claimed in Claim 40, further including the step of 

2 dynamically adjusting said\ctivity hotness threshold for adapting to a current behavior of the 
33 executing computer program.X 

r if 45. The computer program product as claimed in Claim 44, wherein said step of dynamically 

^ 2* adjusting said activity hotness threshold further includes the steps of: 

J an determining an amount of methods characterized as meeting said threshold criteria 

4^ after one or more sampling periods; \ 
§f comparing said amount to a limit and, 

y \ 

^ in response to said comparing, oneVf: decreasing said activity hotness threshold if 

jh said limit is not met, and increasing the threshold if shid limit is met or exceeded in said one or 

8 more sampling periods. \ 

1 46. The computer program product as claimed in Claim 40, fiikher including the step of inserting 

2 intrusive profiling for one or more identified methods. \ 

1 47. The computer program product as claimed in Claim 42, wherein said step of generating a 

2 compilation plan includes: providing an identifier of said method to be optimized; and, an 

3 optimization level indicating a degree of optimization to be applied for said ichmtified method. 
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1 48. The computer program product as claimed in Claim 40, wherein said analyzing step c) 

2 further includes identifying a recompilation level that minimizes expected future running time of 

3 a recKHTipiled version. 

1 49. The computer program product as claimed in Claim 48, wherein said step of identifying a 

2 recompilation le^l includes the steps of: 

3 determining an expected time Tj the program will spend executing a method "m" 

4 if said method is not recompiled; 

5 determining accost Cj of recompiling said method at an optimization level "j", for 

6 i < j < N; and, \ 

determining an expebted time Tj the program will spend executing said method in 

% the future, if said method is recompiledvat level "j"; and, 

^ evaluating the expression CM- Tj < T i5 and, one of: recompiling "m" at level "j" if 

\M said expression is true, and, not recompiling irssaid expression is false. 

h 50. The computer program product as claimed in Claim 37, wherein said optimizing step further 

i'f comprises the step of performing online feedback-direcW optimizations based on feedback from 

j& the current executing program. \ 

1 51. The computer program product as claimed in Claim 50, wheran said raw profile data 

2 samples relate to call context information associated with methods caHed by said program, said 

3 feedback comprising said call context information \ 

1 52. The computer program product as claimed in Claim 50, wherein said raw^profile data 

2 samples relate to current program variable values, said feedback comprising a subset of values 

3 assigned to said variables during program execution. \ 
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53. The computer program product as claimed in Claim 50, wherein said raw profile data 
samples relate to control flow execution within a method, said feedback comprising execution 
frequeilcy--e£c^ paths within said executing method. 



1 54. The computer program product as claimed in Claim 37, wherein saide3ceC 

2 includes an interpreter device. 
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